Information processing apparatus, information processing method, and information processing program for displaying consecutive characters in alignment

ABSTRACT

There is provided an image processing apparatus including an input device configured to receive a stroke input, and a display controller configured to control a displaying of a modified stroke, wherein the modified stroke is synthesized based on characteristic parameters of the received stroke input and characteristic parameters of a reference stroke that has been matched to the received stroke input.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/897,840 (filed on Dec. 11, 2015), which is a National Stage PatentApplication of PCT International Patent Application No.PCT/JP2014/002561 (Filed on May 15, 2014) under 35. U.S.C. § 371, whichclaims priority to Japanese Patent Application No. 2013-133201 (filed onJun. 25, 2013), which are all hereby incorporated by reference in theirentirety.

TECHNICAL FIELD

The present disclosure relates to an information processing apparatus,an information processing method, and an information processing programfor formatting handwritten input characters and figures (hereinafter,collectively referred to as marks).

BACKGROUND ART

From the past, in a handwritten character input and a patternrecognition of a handwritten input character, a series of input strokes(unicursal line constituting mark) undergo recognition processing at atiming at which a certain interval is temporally or spatially caused anddisplayed using a font prepared in a system as text data in most cases.Further, Patent Literature 1 discloses a technique of cutting out ahandwritten input character string for each character and performing acorrection of a character tilt, an interval adjustment, and the like, tothus improve a character recognition rate.

CITATION LIST Patent Literature

-   [PTL 1]

Japanese Patent No. 4741977

SUMMARY Technical Problem

However, even when the same content as that input by a user isdisplayed, there is a large difference in appearance between ahandwritten character and a character in a rendered font. With therendered font, there has been a problem that characteristics such as anuance of an input and a handwriting tendency of a writer will be lost,and a sense of unity as a whole will also be lost in a document combinedwith handwritten figures and the like.

In addition, there have been various problems in the formatting of ahandwritten input mark.

In view of the circumstances as described above, an object of thepresent disclosure is to provide an information processing apparatus, aninformation processing method, and an information processing programwith which handwritten input marks can be formatted appropriately.

Solution to Problem

According to an aspect of the present disclosure, there is provided animage processing apparatus including: an input device configured toreceive a stroke input; and a display controller configured to control adisplaying of a modified stroke, wherein the modified stroke issynthesized based on characteristic parameters of the received strokeinput and characteristic parameters of a reference stroke that has beenmatched to the received stroke input.

According to another aspect of the present disclosure, there is providedan image processing method including: controlling a reception of astroke input; controlling a determination of characteristic parametersof the received stroke input; controlling a synthesizing of a modifiedstroke based on the characteristic parameters of the received strokeinput and characteristic parameters of a reference stroke that has beenmatched to the received stroke input; and controlling the modifiedstroke to be displayed.

According to another aspect of the present disclosure, there is provideda non-transitory computer-readable medium having embodied thereon aprogram, which when executed by a computer causes the computer toperform an image processing method, the method including: controlling areception of a stroke input; controlling a determination ofcharacteristic parameters of the received stroke input; controlling asynthesizing of a modified stroke based on the characteristic parametersof the received stroke input and characteristic parameters of areference stroke that has been matched to the received stroke input; andcontrolling the modified stroke to be displayed.

According to another aspect of the present disclosure, there is providedan image processing system including: a terminal device configured toreceive a stroke input and control a displaying of a modified stroke;and a server device configured to match a reference stroke to thereceived stroke input and synthesize the modified stroke based oncharacteristic parameters of the received stroke input andcharacteristic parameters of the matched reference stroke.

Effect of Invention

As described above, according to embodiments of the present disclosure,a handwritten input mark can be formatted appropriately.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1

A structural diagram showing a structure of an information processingapparatus according to an embodiment.

FIG. 2

A structural diagram showing another structure of the informationprocessing apparatus according to an embodiment.

FIG. 3

A diagram showing an example of a stroke input to an input apparatus 200by a handwritten input of a user.

FIG. 4

A diagram showing a state where a plurality of representative points RPsare extracted as characteristic parameters from input data.

FIG. 5

A diagram showing an example of formatting example data of a character“2”.

FIG. 6

An example of semi-formatted data generated by a correction.

FIG. 7

A diagram showing a state of processing of performing parallel movementor enlargement and contraction processing on bounding boxes BB1 to BB4of respective characters and adjusting sizes, central coordinates, andintervals of the bounding boxes BB1 to BB4.

FIG. 8

A flowchart showing a flow of basic processing carried out by theinformation processing apparatus 100 of an embodiment.

FIG. 9

A diagram showing an example of a GUI for setting a correctioncoefficient k, the diagram showing an example of setting the correctioncoefficient k by a slider S.

FIG. 10

A diagram showing an example of a GUI for setting the correctioncoefficient k, the diagram showing an example of setting the correctioncoefficient k by a user directly dragging a stroke R of semi-formatteddata.

FIG. 11

A flowchart for explaining an entire flow in a case where the correctioncoefficient k is set using a GUI.

FIG. 12

A flowchart for explaining an entire flow in a case where the correctioncoefficient k is set using a context.

DESCRIPTION OF EMBODIMENTS

Hereinafter, embodiments of the present disclosure will be describedwith reference to the drawings.

First Embodiment

[Outline]

In the present disclosure, in formatting a handwritten input stroke(input stroke data) based on a result of a pattern recognition, asemi-formatted stroke is generated while leaving characteristics of theinput stroke instead of fully replacing it by an ideal shape stored on asystem side. As a result, display of easy-to-read characters and figures(marks) is realized while leaving a handwriting nuance and texture. Itshould be noted that in the present disclosure, it can also be said thata handwritten input stroke (input stroke data) and an ideal shape storedon the system side (reference stroke data) are synthesized to generate asemi-formatted stroke.

It should be noted that since the present disclosure presupposes that apattern recognition of characters and figures (marks) is performed,recognized data can of course be used as general text data in a search,a language analysis, and the like.

[Difference from Typical Technique]

In general, in formatting a handwritten input stroke, a correction of adistance or curvature of consecutive sampling points is performedlocally before a pattern recognition of the stroke. Specifically, theformatting performed herein is assumed to be used as preprocessing forimproving a character recognition processing accuracy.

In contrast, in the present disclosure, a handwritten input stroke(mark) is corrected based on a pattern recognition result of the strokeand formatted to become readable, and thus an object and method differfrom those of the typical technique.

[Structure]

Next, a structure of an information processing apparatus of anembodiment will be described. FIG. 1 is a structural diagram showing thestructure of the information processing apparatus according to anembodiment.

The information processing apparatus 100 includes an input controller 1,a recognition processing unit 2, a storage 3, a format processing unit4, and a display controller 5. The information processing apparatus 1 isused with an input apparatus 200 and a display apparatus 300.

The input apparatus 200 is a touchpad or the like and accepts, as astroke, a handwritten input of a user made by a finger, a stylus pen,and the like. It should be noted that the input apparatus 200 may beanything as long as it can accept a handwritten input of the user andmay be, for example, a mouse and a pen tablet.

The input controller 1 controls the input apparatus 200 and acceptsinput data input to the input apparatus 200 by the user.

The recognition processing unit 2 recognizes what the data input by theuser is by a known method for a character recognition or figurerecognition based on a stroke as the input data accepted by the inputcontroller 1.

The storage 3 stores in advance recognition data (including dictionaryfor word recognition) used by the recognition processing unit 2 inperforming the character recognition or figure recognition andformatting example data (reference stroke data) that the formatprocessing unit 4 needs to carry out processing of semi-formatting theinput data. Specifically, the storage 3 is constituted of a hard diskdrive, a nonvolatile memory, and the like.

The format processing unit 4 performs semi-formatting by a correction ofthe input data based on the input data supplied from the inputcontroller 1, the pattern recognition result (e.g., character code incase of character recognition) of the input data supplied from therecognition processing unit 2, the formatting example data taken outfrom the storage 3, and the correction coefficient k. Details of theprocessing of the format processing unit 4 will be described later.

The display controller 5 controls the display apparatus 300 to displayon a screen thereof the semi-formatted data semi-formatted by the formatprocessing unit 4.

The display apparatus 300 is, for example, a liquid crystal display oran organic EL (Electro Luminescence) display and displays formattedinput data under control of the display controller 5.

It should be noted that the input controller 1, the recognitionprocessing unit 2, the format processing unit 4, and the displaycontroller 5 may be realized as functional blocks of a computerincluding a CPU (Central Processing Unit) and the storage 3 by the CPUexecuting information processing programs stored in the storage 3.

Heretofore, the structure of the information processing apparatus 100has been described.

Modified Example 1 (Structure as Electronic Apparatus

In the descriptions above, the information processing apparatus 100 isan apparatus different from the input apparatus 200 and the displayapparatus 300. However, the structure is not limited thereto, and anelectronic apparatus 400 in which the information processing apparatus100, the input apparatus 200, and the display apparatus 300 areintegrated may also be used. In this case, a touch panel in which atransparent touchpad used as the input apparatus 200 is placed above thescreen of the display apparatus 300 and integrated may be structured. Anexample of the electronic apparatus including a touch panel is a tabletPC (Personal Computer).

Modified Example 2 (Structure as Server on Cloud

The block that assumes the semi-formatting processing of an embodimentof the present disclosure is the format processing unit 4. In thisregard, as shown in FIG. 2, for example, the information processingapparatus of the present disclosure may be a server 101 on a cloud thathas the functional block of the format processing unit 4. In this case,essential structures of the server 101 are the format processing unit 4and a transceiver unit 6. The server 101 is used with a terminalapparatus 500 in hand of the user, that includes the input apparatus 200and the display apparatus 300.

The recognition processing unit 2 may be in the terminal apparatus 500,another server 102 on the cloud, or the server 101. The storage 3 mayalso be in another server 103 on the cloud or the server 101. It shouldbe noted that the cloud used herein refers to a server group thatprovides various services on the Internet and is also referred to ascloud computing environment.

The server 101 receives input data handwritten-input by the user fromthe terminal apparatus 500. The server 101 also receives a patternrecognition result (e.g., character code) of the input data from therecognition processing unit 2 mounted on the terminal apparatus 500,another server on the cloud, or the same server 101.

Then, the format processing unit 4 uses the correction coefficient k andthe formatting example data taken out from the storage 3 to performsemi-formatting of the input data. The semi-formatted datasemi-formatted by the format processing unit 4 is transmitted to theterminal apparatus 500 by the transceiver unit.

[Basic Idea of Semi-Formatting Processing]

Next, the basic idea of the semi-formatting processing will bedescribed. Here, descriptions will be given assuming that a stroke asshown in FIG. 3 has been input to the input apparatus 200 by ahandwritten input of the user and a character recognition is carried outby the recognition processing unit 2.

First, based on the input data input by the user, the recognitionprocessing unit 2 performs a character recognition and selects acandidate that is highly likely a most appropriate recognition resultfrom a plurality of recognition candidates. Here, the patternrecognition is performed assuming that the input data is an Arabicnumeral “2”. It should be noted that a known method only needs to beused as the method for the recognition processing carried out by therecognition processing unit 2. The same holds true for recognitions ofEnglish cursive writing and Chinese characters. The semi-formattingprocessing of the present disclosure presupposes accurate recognitionprocessing.

Next, as preprocessing of the semi-formatting processing, the formatprocessing unit 4 calculates characteristic parameter related to thestroke as the input data.

The calculation of the characteristic parameter is carried out by, forexample, extracting coordinate values of a plurality of representativepoints RPs from a stroke constituted of a consecutive dot sequence. FIG.4 is a diagram showing a state where the plurality of representativepoints RPs are extracted as the characteristic parameters from the inputdata.

Here, the storage 3 stores in advance formatting example data that is tobe an example for formatting input data. In the formatting example data,characteristic parameters are calculated in advance so that theprocessing in formatting can be carried out with ease. FIG. 5 is adiagram showing an example of the formatting example data of thecharacter “2”.

Characters that are written by a calligraphy teacher and sold by adealer may be purchased and used as the formatting example data, orformatting example data in which the user writes up and storescharacters to use in advance may be used.

Next, the format processing unit 4 compares the characteristic parameterof the input data and the characteristic parameter of the formattingexample data, corrects the input data so that the stroke of the inputdata approaches that of the formatting example data, and generatessemi-formatted data. FIG. 6 is an example of the semi-formatted datagenerated by the correction. As shown in the figure, in thesemi-formatted data, characters handwritten-input by the user are madeto approach the formatting example data and corrected to an easy-to-readform while leaving a handwriting nuance.

Here, as the characteristic parameters, a case of using normalizedcoordinate values of n (n is a positive number) representative pointsRPs on a stroke will be discussed. It should be noted that thenormalization used herein refers to, for example, an affinetransformation that is performed to make sizes of a bounding boxsurrounding the stroke of the input data (rectangle surrounding dotsequence of stroke) and a bounding box surrounding a stroke of theformatting example data match.

At this time, when the characteristic parameter of the formattingexample data is represented by Pi (0≤i<n), the characteristic parameterof the input data is represented by Qi, and the correction coefficientis represented by k (0<k<1), the characteristic parameter Ri of thesemi-formatted data obtained after the correction can be obtained by thefollowing expression.Ri=kPi+(1−k)Qi

The correction coefficient k may be the same for all the representativepoints RPs, or the correction coefficient k may be varied based on adistance |Pi−Qi| between the characteristic parameter of the input dataand the characteristic parameter of the formatting example data so thatprocessing of intensifying the correction is carried out for the distantrepresentative point RP.

Finally, the format processing unit 4 causes the stroke of thesemi-formatted data generated by the correction to be displayed on thescreen of the display apparatus 300 via the display controller 5.

Heretofore, the basic idea of the semi-formatting processing has beendescribed.

Modified Example 3 (Correction Method that does not Use CorrectionCoefficient k

In the descriptions above, the method of using the correctioncoefficient k in the correction in the semi-formatting has beendescribed. However, other methods that do not use the correctioncoefficient k may be used to generate semi-formatted data. In this case,the following affine transformationRi=AQi+b(A represents a line, and b represents a vector)

may be performed on the characteristic parameter Qi of the input datasuch that the following expression expressing a sum of the distancebetween the characteristic parameter Pi of the formatting example dataand the characteristic parameter Ri of the semi-formatted data becomesminimum.

$\begin{matrix}{\sum\limits_{i = 0}^{n - 1}{{{Pi} - {Ri}}}} & \left\lbrack {{Math}.\mspace{14mu} 2} \right\rbrack\end{matrix}$

Modified Example 4 (Update of Formatting Example Data

Although the prepared formatting example data is not updatedautomatically in the descriptions above, the structure is not limitedthereto, and a structure in which the data is automatically updated mayalso be used. For example, a plurality of characteristic parameters ofmarks (characters and figures) handwritten-input by the users arerecorded in advance, and the past characteristic parameters of the usersare compared with the characteristic parameter of the formatting exampledata. Then, data whose distance from the characteristic parameter of theformatting example data is small may be newly used as the formattingexample data.

<Auxiliary Processing Carried Out During Consecutive Inputs>

When a plurality of marks (characters and figures) are inputconsecutively, processing for a parallel movement, enlargement andcontraction, and the like may be additionally performed for each markbefore or after the semi-formatting processing described above forsuppressing variations in the sizes of areas occupied by the marks,central coordinates, intervals, and the like.

FIG. 7 is a diagram showing a state of processing of performing parallelmovement or enlargement and contraction processing on bounding boxes BB1to BB4 of respective characters and adjusting sizes, centralcoordinates, and intervals of the bounding boxes BB1 to BB4. By thisprocessing, the handwritten input characters are aligned as in boundingboxes BB1′ to BB4′ shown on the lower side of the figure.

[Basic Processing Flow]

Next, a basic processing flow will be described. FIG. 8 is a flowchartshowing the basic processing flow carried out by the informationprocessing apparatus 100 of an embodiment.

First, the input controller 1 accepts a stroke input to the inputapparatus 200 by the user as input data. The accepted input data issupplied to the recognition processing unit 2 and the format processingunit 4 (Step ST1).

Next, the recognition processing unit 2 acquires pattern recognitiondata from the storage 3 and carries out recognition processing of theinput data supplied from the input controller 1 to convert it into markidentification information including a character code and figure data(Step ST2).

Next, the format processing unit 4 invokes formatting example datacorresponding to the mark identification information including acharacter code and figure data, that has been supplied from therecognition processing unit 2, from the storage 3 (Step ST3).

Next, for normalizing the formatting example data according to the inputdata, the format processing unit 4 carries out preprocessing by anaffine transformation (Step ST4).

Subsequently, the format processing unit 4 sets the correctioncoefficient k (Step ST5).

The correction coefficient k may be a value preset by the system, avalue set by the user, or a value that is set statically or dynamically.

Finally, the format processing unit 4 generates semi-formatted data byperforming a correction by the semi-formatting processing of the inputdata (input stroke) based on the set correction coefficient k and theformatting example data subjected to the affine transformation. Thegenerated semi-formatted data is displayed on a display screen of thedisplay apparatus 5 via the display controller 5 (Step ST6).

Heretofore, the basic processing flow carried out by the informationprocessing apparatus 100 has been described.

[Setting Method of Correction Coefficient k]

Next, a setting method of the correction coefficient k described abovewill be described. There are largely two methods for the setting methodof the correction coefficient k. One is a method in which a usermanually sets the correction coefficient k using a GUI (Graphical UserInterface). The other is a method of automatically setting thecorrection coefficient k using a context (environment condition) usedwhen a user inputs a stroke.

(Setting of Correction Coefficient k Using GUI)

First, a setting method of the correction coefficient k using a GUI willbe described. FIGS. 9 and 10 are diagrams each showing an example of aGUI for setting the correction coefficient k. FIG. 9 is a diagramshowing an example of setting the correction coefficient k by a sliderS, and a stroke R of the semi-formatted data approaches a stroke P ofthe formatting example data displayed on top of the stroke R as aposition of a tab of the slider S moves toward the “strong” side.

FIG. 10 is a diagram showing an example of setting the correctioncoefficient k by the user directly dragging the stroke R of thesemi-formatted data. The user holds a point RA on the stroke R of thesemi-formatted data and drags it. Then, the format processing unit 4calculates and sets the correction coefficient k from a distance betweencoordinates of the dragged point RA and coordinates of a point PA on thestroke P of the formatting example data corresponding to the point RA.

(Entire Flow in Setting Correction Coefficient k Using GUI)

FIG. 11 is a flowchart for explaining an entire flow in a case where thecorrection coefficient k is set using a GUI. Since the processes fromStep ST1 to Step ST6 are the same as those described above, descriptionsthereof will be omitted. It should be noted that when Step ST5 isexecuted first, a value that is set in the information processingapparatus 100 as an initial value is used as the value of the correctioncoefficient k.

First, after the stroke R semi-formatted in Step ST6 by the correctioncoefficient k as the initial value is displayed on the screen, theformat processing unit 4 causes a GUI for adjusting the correctioncoefficient k to be displayed on the display screen of the displayapparatus 300 via the display controller 5 (Step ST7).

Next, the format processing unit 4 judges whether there has been aninstruction from the user to adjust the correction coefficient k (StepST8).

When there has been no instruction from the user (No in Step ST8), theformat processing unit 4 ends the processing.

When there has been an instruction from the user (Yes in Step ST8), theformat processing unit 4 returns to the processing of Step ST5, sets avalue that is based on the instruction as the correction coefficient k,and continues the processing.

It should be noted that the correction coefficient k may be adjustedevery time a handwritten input is made, or the same correctioncoefficient k may continuously be used as long as the user does notexplicitly instruct the adjustment once the adjustment is made.

Heretofore, the entire flow in the case of setting the correctioncoefficient k using a GUI has been described.

(Setting of Correction Coefficient k Using Context (EnvironmentCondition))

Next, a setting method of the correction coefficient k using a context(environment condition) will be described. An example of the context isa login ID that the user uses to log in to the information processingapparatus 100. By using such a login ID, the semi-formatting processingcan be carried out using the correction coefficient k differently setfor each user. It should be noted that the user currently making ahandwritten input may be identified by a face recognition instead of thelogin ID.

Further, another example of the context is a type of applicationsoftware to which the user inputs data by a handwritten input. Forexample, a correction may be weak in a hobby application and be strongin a business application.

Moreover, a type of the apparatus that the user uses may be used as thecontext. In this case, the correction may be strong in a portableterminal apparatus and be weak in a stationary apparatus such as adesktop PC.

Furthermore, whether to allow the input data to be viewed or not mayalso be used as the context. For example, the correction may be strongwith respect to data to be viewed.

Further, the strongness and weakness of the correction may be adjustedby a character type to which the input data belongs, for example,alphabets, Chinese characters, Hiragana, Katakana. Arabic alphabets,Cyrillic alphabets, and Hangeul.

Moreover, an area for performing a handwritten input may be sectioned sothat the value of the correction coefficient k can be adjustedindependently for each of the sectioned areas.

Heretofore, the examples of the context for setting the correctioncoefficient k have been described.

(Entire Flow in Setting Correction Coefficient k Using Context(Environment Condition))

FIG. 12 is a flowchart for explaining an entire flow in a case where thecorrection coefficient k is set using a context. Since the processesfrom Step ST1 to Step ST6 are the same as those described above,descriptions thereof will be omitted.

First, after the recognition processing unit 2 carries out therecognition processing in Step ST2, the format processing unit 4acquires context information (Step STA).

Then, after the format processing unit 4 performs the affinetransformation in Step ST4, the format processing unit 4 calculates thecorrection coefficient k (Step STB).

It should be noted that in the descriptions above, Step STA is carriedout after Step ST2, and Step STB is carried out after Step ST4. However,the order is not limited thereto, and Step STA and Step STB may becarried out at any time point as long as Step STA and Step STB arecarried out in the stated order before the setting processing of thecorrection coefficient k of Step ST5.

Heretofore, the entire flow in the case where the correction coefficientk is set using a context has been described.

Modified Example 5 (Formatting of Recognition Candidate

The semi-formatting processing of the present disclosure is basicallycarried out after the pattern recognition of a mark (character andfigure). However, when the user explicitly tries a re-recognition in thecase where the recognition processing is not carried out appropriately,a plurality of marks are presented to the user as recognitioncandidates, for example. At this time, a stroke obtained by subjectingthe candidate mark to be presented to the semi-formatting processing maybe presented, or a corresponding stroke of the formatting example datamay be presented. Which of the strokes is to be presented may bedesignated by the user.

The present technology may be embodied as the following configurations.

(1) An image processing apparatus including:

-   -   an input device configured to receive a stroke input; and    -   a display controller configured to control a displaying of a        modified stroke,    -   wherein the modified stroke is synthesized based on        characteristic parameters of the received stroke input and        characteristic parameters of a reference stroke that has been        matched to the received stroke input.

(2) The image processing apparatus of (1), wherein the synthesizedmodified stroke is an interpolation result generated based on thecharacteristic parameters of the received stroke input and thecharacteristic parameters of the reference stroke, and the synthesizedmodified stroke falls between the received stroke input and thereference stroke.

(3) The image processing apparatus of (1) or (2), further includes: arecognition processing unit configured to match the reference stroke tothe received stroke input.

(4) The image processing apparatus of any of (1) through (3), whereinthe modified stroke is provided to the display controller from a server.

(5) An image processing method including:

-   -   controlling a reception of a stroke input;    -   controlling a determination of characteristic parameters of the        received stroke input;    -   controlling a synthesizing of a modified stroke based on the        characteristic parameters of the received stroke input and        characteristic parameters of a reference stroke that has been        matched to the received stroke input; and    -   controlling the modified stroke to be displayed.

(6) The image processing method of (5), wherein the synthesized modifiedstroke is an interpolation result generated based on the characteristicparameters of the received stroke input and the characteristicparameters of the reference stroke, and the synthesized modified strokefalls between the received stroke input and the reference stroke.

(7) The image processing method of (5) or (6), wherein the controllingthe synthesizing of the modified stroke includes a comparison betweenthe characteristic parameters of the received stroke input and thecharacteristic parameters of the matched reference stroke.

(8) The image processing method of any of (5) through (7), wherein thematched reference stroke is a determination result of a characterrecognition process performed upon the received stroke input.

(9) The image processing method of any of (5) through (8), wherein thematched reference stroke is a candidate, selected from a plurality ofcandidate strokes, that is most similar to the received stroke input.

(10) The image processing method of any of (5) through (9), wherein thecharacteristic parameters of the received stroke input includecoordinate values of representative points along the received strokeinput, and the characteristic parameters of the reference stoke includerespective coordinate values of representative points along thereference stroke.

(11) The image processing method of any of (5) through (10), wherein thesynthesized modified stroke represents a partial-correction of thereceived stroke input that is partially-corrected based on the matchedreference stroke.

(12) The image processing method of any of (5) through (11), wherein themodified stroke is synthesized to satisfy the relationshipRi=kPi+(1−k)Qi

wherein characteristic parameters of the modified stroke is representedby Ri, the characteristic parameters of the reference stroke isrepresented by Pi, the characteristic parameters of the received strokeinput is represented by Qi, and a correction coefficient is representedby k (0<k<1).

(13) The image processing method of any of (5) through (12), wherein kis defined based on an environmental condition existing when the strokeinput is received.

(14) The image processing method of any of (5) through (13), wherein thecharacteristic parameters of the received stroke input and thecharacteristic parameters of the reference stroke are normalized byaffine transformation.

(15) The image processing method of any of (5) through (14), wherein thereceived stroke input is a handwritten input that is input upon an inputdevice.

(16) The image processing method of any of (5) through (15), wherein thereceived stroke input is a gesture input.

(17) The image processing method of any of (5) through (16), wherein themodified stroke is synthesized to maintain a stylistic characteristic ofthe received stroke input.

(18) A non-transitory computer-readable medium having embodied thereon aprogram, which when executed by a computer causes the computer toperform an image processing method, the method including:

-   -   controlling a reception of a stroke input;    -   controlling a determination of characteristic parameters of the        received stroke input;    -   controlling a synthesizing of a modified stroke based on the        characteristic parameters of the received stroke input and        characteristic parameters of a reference stroke that has been        matched to the received stroke input; and    -   controlling the modified stroke to be displayed.

(19) An image processing system including:

-   -   a terminal device configured to        -   receive a stroke input and        -   control a displaying of a modified stroke; and    -   a server device configured to        -   match a reference stroke to the received stroke input and        -   synthesize the modified stroke based on characteristic            parameters of the received stroke input and characteristic            parameters of the matched reference stroke.

(20) The image processing system of (19), wherein the synthesizedmodified stroke is an interpolation result generated based on thecharacteristic parameters of the received stroke input and thecharacteristic parameters of the matched reference stroke, and thesynthesized modified stroke falls between the received stroke input andthe matched reference stroke.

(21) An information processing apparatus, comprising

-   -   a processing unit configured to acquire input stroke data of a        handwritten input mark and reference stroke data of the mark and        synthesize the acquired input stroke data and the acquired        reference stroke data.

(22) The information processing apparatus according to (21),

-   -   wherein the processing unit additionally acquires mark        identification information obtained by a pattern recognition        with respect to the input stroke data and acquires the reference        stroke data based on the acquired mark identification        information.

(23) The information processing apparatus according to (22).

-   -   wherein the processing unit performs the synthesis such that the        following expression is satisfied when parameters expressing        characteristics of the reference stroke data, the input stroke        data, and stroke data as a result of the synthesis are        represented by Pi, Qi, and Ri (0<i<n, n is a positive number)        and a correction coefficient is represented by k (0<k<1).        Ri=kPi+(1−k)Qi

(24) The information processing apparatus according to (23),

-   -   wherein the processing unit acquires an environment condition        used when the user inputs the input stroke data and sets the        correction coefficient based on the acquired environment        condition.

(25) The information processing apparatus according to (23),

-   -   wherein the processing unit varies the correction coefficient        based on a distance |Pi−Qi| between the parameter expressing the        characteristics of the input stroke data and the parameter        expressing the characteristics of the reference stroke data.

(26) The information processing apparatus according to (22),

-   -   wherein the processing unit performs an affine transformation        Ri=AQi+b (A represents a line, and b represents a vector) on Qi        such that the following expression expressing a sum of a        distance between Pi and Ri becomes minimum when parameters        expressing characteristics of the reference stroke data, the        input stroke data, and stroke data as a result of the synthesis        are represented by Pi, Qi, and Ri (0≤i<n, n is a positive        number).

$\begin{matrix}{\sum\limits_{i = 0}^{n - 1}{{{Pi} - {Ri}}}} & \left\lbrack {{Math}.\mspace{14mu} 3} \right\rbrack\end{matrix}$

(27) An information processing method, comprising:

-   -   acquiring, by a processing unit, input stroke data of a        handwritten input mark and reference stroke data of the mark;        and    -   synthesizing, by the processing unit, the acquired input stroke        data and the acquired reference stroke data.

(28) An information processing program for causing a computer tofunction as

-   -   a processing unit configured to acquire input stroke data of a        handwritten input mark and reference stroke data of the mark and        synthesize the acquired input stroke data and the acquired        reference stroke data.

Supplementary Note

In addition, the present disclosure is not limited to the embodimentsdescribed above and can be variously modified without departing from thegist of the present disclosure.

REFERENCE SIGNS LIST

-   1 input controller-   2 recognition processing unit-   3 storage-   4 format processing unit-   5 display controller-   6 transceiver unit-   100 information processing apparatus-   101-103 server-   200 input apparatus-   300 display apparatus-   400 electronic apparatus-   500 terminal apparatus

The invention claimed is:
 1. An information processing apparatus,comprising: a display; a touch pad configured to receive a consecutivestroke input given by a user; and a processor configured to recognizethat the consecutive stroke input including at least two characters hasbeen received by the touch pad, perform, in parallel and afterrecognition of the at least two characters of the consecutive strokeinput, an enlargement processing or a contraction processing on the atleast two characters of the consecutive stroke input to align the atleast two characters in relative alignment with each other, and displaythe at least two characters in relative alignment with each other, afterthe enlargement processing or the contraction processing has beenperformed on the consecutive stroke input.
 2. The information processingapparatus according to claim 1, wherein the processor performs theenlargement processing or the contraction processing on the consecutivestroke input to reposition the at least two characters to be aligned andin unity with each other.
 3. The information processing apparatusaccording to claim 1, wherein the processor performs the enlargementprocessing or the contraction processing on the consecutive stroke inputto reposition the at least two characters to be aligned.
 4. Theinformation processing apparatus according to claim 1, wherein theprocessor performs the enlargement processing or the contractionprocessing on the consecutive stroke input based on a correctioncoefficient.
 5. The information processing apparatus according to claim1, wherein the processor performs the enlargement processing or thecontraction processing on the consecutive stroke input by normalizingcharacteristic parameters of the at least two characters of the receivedconsecutive stroke input.
 6. The information processing apparatusaccording to claim 1, wherein the processor performs the enlargementprocessing or the contraction processing on the consecutive stroke inputby interpolating characteristic parameters of the at least twocharacters of the received consecutive stroke input.
 7. The informationprocessing apparatus according to claim 1, wherein the consecutivestroke input given by the user is a handwritten input that is input uponthe touch pad.
 8. The information processing apparatus according toclaim 1, wherein the consecutive stroke input given by the user is agesture input.
 9. The information processing apparatus according toclaim 1, wherein a stylistic characteristic of the consecutive strokeinput given by the user is maintained as the processor performs theenlargement processing or the contraction processing on the consecutivestroke input.
 10. An information processing method, comprising:receiving a consecutive stroke input given by a user on a touch pad;recognizing that the consecutive stroke input including at least twocharacters has been received by the touch pad; performing, in paralleland after recognition of the at least two characters of the consecutivestroke input, an enlargement processing or a contraction processing onthe at least two characters of the consecutive stroke input to align theat least two characters in relative alignment with each other; anddisplaying the at least two characters in relative alignment with eachother, after the enlargement processing or the contraction processinghas been performed on the consecutive stroke input.
 11. A non-transitorycomputer-readable medium having embodied thereon a program, which whenexecuted by a computer causes the computer to perform an informationprocessing method, the method comprising: receiving a consecutive strokeinput given by a user on a touch pad; recognizing that the consecutivestroke input including at least two characters has been received by thetouch pad; performing, in parallel and after recognition of the at leasttwo characters of the consecutive stroke input, an enlargementprocessing or a contraction processing on the at least two characters ofthe consecutive stroke input to align the at least two characters inrelative alignment with each other; and displaying the at least twocharacters in relative alignment with each other, after the enlargementprocessing or the contraction processing has been performed on theconsecutive stroke input.
 12. The information processing apparatusaccording to claim 1, wherein the processor displays the at least twocharacters in relative alignment with each other and proportionate insize.
 13. The information processing method according to claim 10,wherein the at least two characters are displayed in relative alignmentwith each other and proportionate in size.
 14. The non-transitorycomputer-readable medium according to claim 11, wherein in the performedinformation processing method, the at least two characters are displayedin relative alignment with each other and proportionate in size.